Toward Adaptive Generation of Backchannels for Attentive Listening Agents
نویسندگان
چکیده
Backchannels play an important role in spoken dialogue, especially in attentive listening such as counseling. Appropriately coordinated backchannels help establish rapport in that kind of dialogue. We investigate whether and how synchrony is expressed by the prosodic features of backchannels with respect to the preceding speaker’s utterances. By analyzing counseling dialogue, we find out correlation patterns according to the type of backchannels and prosodic features; a larger correlation is observed for reactive tokens than acknowledging tokens and for the power features than the pitch features. Based on the observations, we also conduct prediction of prosodic parameters of backchannels in order to replace the conventional conversational systems that generate monotonous backchannels.
منابع مشابه
Attentive listening system with backchanneling, response generation and flexible turn-taking
Attentive listening systems are designed to let people, especially senior people, keep talking to maintain communication ability and mental health. This paper addresses key components of an attentive listening system which encourages users to talk smoothly. First, we introduce continuous prediction of end-of-utterances and generation of backchannels, rather than generating backchannels after en...
متن کاملAnalysis and Prediction of Morphological Patterns of Backchannels for Attentive Listening Agents
Backchannels play an important role in smooth dialogue, especially attentive listening. In this paper, we analyze the morphological patterns (category) of backchannels, and how these relate to linguistic features of the preceding utterance. In particular we consider the type of the previous utterance-end boundary, the linguistic complexity of the previous utterance, and other features. Based on...
متن کاملPrediction and Generation of Backchannel Form for Attentive Listening Systems
In human-human dialogue, especially in attentive listening such as counseling, backchannels are important not only for smooth communication but also for establishing rapport. Despite several studies on when to backchannel, most of the current spoken dialogue systems generate the same pattern of backchannels, giving monotonous impressions to users. In this work, we investigate generation of a va...
متن کاملThe Effect of Multiple Modalities on the Perception of a Listening Agent
Listening agents are IVAs that display attentive listening behavior to a human speaker. The research into listening agents has mainly focused on (1) automatically timing listener responses; and (2) investigating the perceptual quality of listening behavior. Both issues have predominantly been addressed in an offline fashion, e.g. based on controlled animations that were rated by human observers...
متن کاملIntegrating Backchannel Prediction Models into Embodied Conversational Agents
In this paper we will present our design for generating listening behavior for embodied conversational agents. It uses a corpus based prediction model to predict the timing of backchannels. The design of the system iterates on a previous design (Huang et al. [5]) on which we propose improvements in terms of robustness and personalization. For robustness we propose a variable threshold determine...
متن کامل